Database backup system using data and user-defined routines replicators for maintaining a copy of database on a secondary server

ABSTRACT

In a database system having a primary server side ( 10 ) and a secondary server side ( 30 ), a high availability data replicator ( 26, 46 ) transfers log entries from the primary side ( 10 ) to the secondary side ( 30 ) and replays the transferred log entries to synchronize the secondary side ( 30 ) with the primary side ( 10 ). R-tree index transfer threads ( 54, 56 ) copy user-defined routines, the user defined index, and index databases deployed on the primary server side ( 10 ) to the secondary server side ( 30 ) and deploy the copied user-defined routines, reconstruct the user-defined index, and copy data pages on the secondary side ( 30 ) to make the user-defined index consistent and usable on the secondary side ( 30 ).

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to the art of information processing. Itfinds particular application in high availability database systemsemploying range tree indexing, and will be described with particularreference thereto. However, the present invention is useful in otherinformation storage environments that employ hot backup systems anduser-defined indexing.

2. Description of Related Art

Database environments for businesses and other enterprises should havecertain characteristics, including high reliability, robustness in theevent of a failure, and fast and efficient search capabilities. Highreliability includes ensuring that each transaction is entered into thedatabase system. Robustness includes ensuring that the database isfault-tolerant, that is, resistant to hardware, software, and networkfailures. High reliability and robustness are important in many businesssettings where lost transactions or an extended server downtime can be asevere hardship, and can result in lost sales, improperly tracked orlost inventories, missed product deliveries, and the like.

To provide high reliability and robustness in the event of a databaseserver failure, high availability data replicators are advantageouslyemployed. These data replicators maintain a “hot backup” server having aduplicate copy of the database that is synchronized with the primarydatabase deployed on a primary server. The primary server is ordinarilyaccessed by database users for full read/write access. Preferably, thesecondary server handles some read-only database requests to helpbalance the user load between the primary and secondary servers.Database synchronization is maintained by transferring database logentries from the primary server to the secondary server. The transferreddatabase logs are replayed on the secondary server to duplicate thecorresponding transactions in the duplicate copy of the database. Withsuch a data replicator, a failure of the primary server does not resultin failure of the database system; rather, in the event of a primaryserver failure the secondary server takes over as a an interim primaryserver until the failure can be diagnosed and resolved. The secondaryserver can provide users with read-only access or with full read-writeaccess to the database system during the interim.

Advantageously, high availability data replicators provide substantiallyinstantaneous fail-over recovery for substantially any failure mode,including failure of the database storage medium or media, catastrophicfailure of the primary server computer, loss of primary server networkconnectivity, extended network lag times, and the like. The secondaryserver is optionally geographically located remotely from the primaryserver, for example in another state or another country. Geographicalremoteness ensures substantially instantaneous fail-over recovery evenin the event that the primary server is destroyed by an earthquake,flood, or other regional catastrophe. As an added advantage, thesecondary server can be configured to handle some read-only userrequests when both primary and secondary servers are operating normally,thus balancing user load between the primary and secondary servers.

A problem can arise, however, in that high availability data replicationis not compatible with certain database features that do not producedatabase log entries. For example, a range tree index (also known in theart as an R-tree index) includes user-defined data types anduser-defined support and strategy functions. Employing an R-tree indexor other type of user-defined index system substantially improves thesimplicity and speed of database queries for certain types of queries.An R-tree index, for example, classifies multi-dimensional databasecontents into hierarchical nested multi-dimensional range levels basedon user-defined data types and user-defined routines. A database queryaccessing the R-tree index is readily restricted to one or a few rangelevels based on dimensional characteristics of parameters of thedatabase query. The reduced scope of data processed by the queryimproves speed and efficiency. Advantageously, the R-tree index isdynamic, with the user-defined routines re-classifying database contentsinto updated hierarchical nested multi-dimensional range levelsresponsive to changes in database contents.

The operations involved in creating the user defined routines definingthe R-tree typically do not generate corresponding database log entries.As a result, heretofore R-tree indexes and other user-defined indexeshave been incompatible with high availability data replication. Creationof the R-tree index user-defined routines occurs outside the databasesystem and does not result in generation of corresponding database logentries. Hence, the R-tree index is not transferred to the duplicatedatabase on the secondary server during log-based data replication, andsubsequent database log entries corresponding to queries which accessthe R-tree index are not properly replayed on the secondary server.

One way to address this problem would be to construct the R-tree indexentirely using database operations which create corresponding databaselog entries. However, constructing the user-defined routines within thestrictures of logged database operations would substantially restrictflexibility of user-defined routines defining the R-tree index system,and may in fact be unachievable in certain database environments.

In another approach to overcoming this problem, identical copies of theuser-defined routines defining the R-tree index are separately installedon the primary and secondary servers prior to initiating databaseoperations. This solution has certain logistical and practicaldifficulties. The user-defined routines should be installed identicallyon the primary and secondary servers to ensure reliable and robustbackup of database operations which invoke the R-tree index. Because theprimary and secondary servers may be located in different cities, indifferent states, or even in different countries, ensuring identicalinstallation of every user-defined routine of the R-tree on the twoservers can be difficult. In the event of a fail-over, it may benecessary to repeat the installation of the user-defined routines on thefailed server, further increasing downtime.

The present invention contemplates an improved method and apparatuswhich overcomes these limitations and others.

SUMMARY OF THE INVENTION

In accordance with one aspect of the invention, an indexing method isprovided for use in a database including primary and secondary serversand a data replicator that copies database log entries from the primaryserver to the secondary server and updates the secondary server usingthe copied database log entries. A user-defined index of contents of thedatabase is created on the primary server. The user-defined indexincludes at least user-defined routines and the creating includes atleast some operations that do not produce database log entries. A lockon the user-defined index is obtained on the primary server, and adefinitional data set containing information on the user-definedroutines is constructed. The definitional data set is transferred fromthe primary server to the secondary server. Secondary user-definedroutines are constructed on the secondary server based on thedefinitional data set. Contents of the user-defined index aretransferred from the primary server to the secondary server astransferred contents. The transferred contents in combination with thesecondary user-defined routines define a secondary user-defined indexcorresponding to the user-defined index created on the primary server.The lock on the user-defined index is removed.

In accordance with another aspect of the invention, a database backupsystem is disclosed for monitoring a database deployed on a primaryserver and for maintaining a copy of said database on a secondaryserver. A data replicator in operative communication with the primaryand secondary servers copies database log entries from the primaryserver to the secondary server and updates the secondary server usingthe copied database log entries. A user-defined routines replicator inoperative communication with the primary and secondary servers copiesuser-defined routines deployed on the primary server to the secondaryserver and deploys the copies of the user-defined routines on thesecondary server.

In accordance with yet another aspect of the invention, an article ofmanufacture is disclosed comprising one or more program storage mediareadable by a computer and embodying one or more instructions executableby the computer to perform a method for maintaining a multi-dimensionalindex of contents of a database system. The database system includes aprimary database deployed on a primary side, a secondary databasedeployed on a secondary side, and a data replication module replicatingcontents of the primary database to the secondary database by replayingdatabase log entries of the primary database on the secondary side.After creation of the multi-dimensional index of contents and prior toexecuting database operations that access the multi-dimensional index ofcontents, an index replication process is performed, including: lockingthe multi-dimensional index on the primary side; copying themulti-dimensional index to the secondary side; and unlocking themulti-dimensional index on the primary side. After the performing of theindex replication process, database operations that access themulti-dimensional index of contents are performed on the primary sideand database log entries corresponding thereto are replayed on thesecondary side. The replaying accesses the copy of the multi-dimensionalindex on the secondary side.

Numerous advantages and benefits of the invention will become apparentto those of ordinary skill in the art upon reading and understandingthis specification.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention may take form in various components and arrangements ofcomponents, and in various process operations and arrangements ofprocess operations. The drawings are only for the purposes ofillustrating preferred embodiments and are not to be construed aslimiting the invention.

FIG. 1 shows a block diagram of a primary server side of a databasesystem that employs high availability data replication with a range treeindex.

FIG. 2 shows a block diagram of a secondary server side of the databasesystem.

FIG. 3 shows a block diagram of data transfer processes forsynchronizing the database including the range tree index on primaryserver side with the secondary server side.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

With reference to FIG. 1, a primary server side 10 of a database systemincludes a primary server 12, which can be a server computer, mainframecomputer, high-end personal computer, or the like. The primary server 12maintains a primary database on a non-volatile storage medium 14, whichcan be a hard disk, optical disk, or other type of storage medium. Theserver 12 executes a suitable database system program, such as anInformix Dynamic Server program or a DB2 database program, bothavailable from IBM Corporation, or the like, to create and maintain theprimary database.

The database is suitably configured as one or more tables describable ashaving rows and columns, in which database entries or records correspondto the rows and each database entry or record has fields correspondingto the columns. The database can be a relational database, a hierarchaldatabase, a network database, an object relational database, or thelike.

To provide faster data processing, portions of the database contents, orcopies thereof, typically reside in a more accessible shared memory 16,such as a random access memory (RAM). For example, a database workspace20 preferably stores database records currently or recently accessed orcreated by database operations. The server 12 preferably executesdatabase operations as transactions each including one or morestatements that collectively perform the database operations.Advantageously, a transaction can be committed, that is, madeirrevocable, or can be rolled back, that is, reversed or undone, basedon whether the statements of the transaction successfully executed andoptionally based on other factors such as whether other relatedtransactions successfully executed.

Rollback capability is provided in part by maintaining a transaction logthat retains information on each transaction. Typically, a logical logbuffer 22 maintained in the shared memory 16 receives new transactionlog entries as they are generated, and the logical log buffer 22 isoccasionally flushed to the non-volatile storage 14 for longer termstorage. In addition to enabling rollback of uncommitted transactions,the transaction log also provides a failure recovery mechanism.Specifically, in the event of a failure, a log replay module 24 canreplay transaction logs of transactions that occurred after the failureand which were not recorded in non-volatile storage or were otherwiselost, so as to recreate those transactions.

The commit/rollback arrangement provides enhanced reliability androbustness by avoiding failed transactions or combinations oftransactions which could lead to inconsistent data in the database. Tostill further enhance reliability and robustness, the database systempreferably provides a locking capability by which a transaction canacquire exclusive or semi-exclusive access to rows or records of thedatabase involved in the transaction. Such locking preferably providesvarious levels of exclusivity or semi-exclusivity in accessing thelocked rows. For example, a lock can prevent other transactions fromboth read and write access to the locked row, or can prevent only writeaccess to the row by other transactions, or so forth. Locking enhancesdatabase reliability and robustness by reducing a likelihood ofdifferent transactions accessing the same row and creating inconsistentdata in that row.

The described commit/rollback, log replay, and row locking mechanismsare exemplary techniques for enhancing reliability and robustness of thedatabase on the primary server 10. Those skilled in the art can readilyconstruct other mechanisms for ensuring integrity of data in the primarydatabase stored and maintained on the primary side 10. However, suchmechanisms do not protect against certain database failure modes. Forexample, the storage medium 14 could fail making stored databasecontents unreadable. Similarly, the server 12 could crash or its networkconnectivity could be lost, making the database on the primary side 10inaccessible for an extended period of time.

With continuing reference to FIG. 1 and with further reference to FIGS.2 and 3, to provide further reliability and robustness, a highavailability data replicator is preferably provided. This replicatormaintains a synchronized duplicate database on a secondary server side30. As shown in FIG. 2, the secondary server side 30 includes asecondary server 32, non-volatile storage medium 34, a shared memory 36containing a workspace 40 for the secondary database and a logical logbuffer 42 holding transaction logs of transactions occurring on theprimary server 10, and a log replay module 44. Preferably, the secondaryside 30 is physically remote from the primary side 10. For example, theprimary and secondary sides 10, 30 can be in different buildings,different cities, different states, or even different countries. Thispreferred geographical remoteness enables the database system to surviveeven regional catastrophes. Although geographical remoteness ispreferred, it is also contemplated to have the primary and secondarysides 10, 30 more proximately located, for example in the same buildingor even in the same room.

The high availability data replicator includes a high availability datareplicator (HDR) buffer 26 on the primary side 10 which receives copiesof the data log entries from the logical log buffer 22. As indicated bya dotted arrow in FIG. 3, contents of the data replicator buffer 26 onthe primary side 10 are occasionally transferred to a high availabilitydata replicator (HDR) buffer 46 on the secondary side 30. As indicatedin FIG. 2, on the secondary side 30, the log replay module 44 replaysthe transferred log entries stored in the replicator buffer 46 toduplicate the transactions corresponding to the transferred logs on thesecondary side 30.

In a preferred embodiment, the logical log buffer 22 on the primary side10 is not flushed until the primary side 10 receives an acknowledgmentfrom the secondary side 30 that the log records were received from thedata replicator buffer 26. This approach ensures that substantially notransactions committed on the primary side 10 are left uncommitted orpartially committed on the secondary side 30 if a failure occurs.Optionally, however, contents of the logical log buffer 22 on theprimary side 10 can be flushed to non-volatile memory 14 after thecontents are transferred into the data replicator buffer 26.

In operation, users typically access the primary side 10 of the databasesystem and interact therewith. As transactions execute on the primaryside 10, transaction log entries are created and transferred by the highavailability data replicator to the secondary side 30 where they arereplayed to maintain synchronization of the duplicate database on thesecondary side 30 with the primary database on the primary side 10. Inthe event of a failure of the primary side 10 (for example, a hard diskcrash, a lost network connection, a substantial network delay, acatastrophic earthquake, or the like) user connections are switched overto the secondary side 30.

In one embodiment, the secondary side 30 takes over in a read-onlycapacity, providing users with access to database contents but notallowing users to add, delete, or modify the database contents. Thisapproach is particularly suitable for short outages such as may becaused by network delays or other temporary loss of networkconnectivity. In another embodiment, the secondary side 30 takes over ina fully operational mode that provides both read and write access. Thisapproach may be preferred when the primary side 10 is out of commissionfor a more extended period of time. As an added benefit, during periodsof normal operation in which both the primary side 10 and the secondaryside 30 are fully operational, the secondary side 30 preferably servicessome read-only user database queries, to advantageously balance userload between the primary and secondary sides 10, 30.

The primary side 10 also includes one or more user-defined indexes, suchas an exemplary range tree (R-tree) index, which is a well-knownindexing method supported, for example, by the Informix Dynamic Serverprogram and the DB2 database program. The Informix Dynamic Serverenvironment, for example, provides an R-tree access method 48 and adefinition of a default R-tree operator class, rtree_ops.

To take advantage of R-tree indexing, user-defined data types anduser-defined routines are typically defined to support a specific rangetree index for a specific database topology. A range tree index includeshierarchical nested multi-dimensional range levels based on theuser-defined data types and the user-defined routines. Preferably, theR-tree index is dynamic, with the user-defined routines re-classifyingdatabase contents into updated hierarchical nested multi-dimensionalrange levels responsive to addition, modification, or deletion ofdatabase content by a user.

The software used to generate and store the user defined routinesgenerally involves operations other than database transactions. As aresult, the operations generating and storing the user defined routinesdo not create corresponding transaction log entries, and so thelog-based high availability data replicator does not transfer theuser-defined routines that define a specific R-tree index to thesecondary side 30.

For example, in the Informix Dynamic Server environment, theuser-defined routines defining the R-tree index are stored on theprimary side 10 as a definitional data set such as an R-tree capsule 50residing in the shared memory 16. The R-tree index includesmulti-dimensional range levels such as one or more root levels, branchlevels, and leaf levels. Indexing information is stored in R-tree indexpages 52. Those skilled in the art can readily construct other specificdata storage structures for storing the user-defined routines andindexing information of the R-tree index. Regardless of the storageconfiguration, however, if some or all of the operations creating theR-tree index are not database transactions having correspondingtransaction logs recorded in the logical log buffer 22, then thelog-based data replication does not transfer this information to thesecondary side 30.

To ensure accurate duplication of the database from the primary side 10to the secondary side 30, an R-tree index transfer thread 54 executingon the primary side 10 cooperates with an R-tree index transfer thread56 executing on the secondary side 30 to create a duplicate copy of theR-tree index information on the secondary side 30, including a duplicateR-tree capsule 60 and duplicate R-tree index pages 62.

In a preferred embodiment, the R-tree index transfer threads 54, 56perform the R-tree index transfer as follows. The R-tree transfer thread54 on the primary side 10 acquires a lock 66 on the R-tree index. Thislock ensures that the R-tree index on the primary side 10 is notmodified by some other process during the index transfer. The R-treetransfer thread 54 on the primary side 10 then acquires the R-treecapsule 50 by reading the capsule information from correspondingpartition pages of the database workspace 20 belonging to the R-treeindex, scans the capsule pages and transfers them from the primary side10 to the secondary side 30, as indicated by the dotted arrow in FIG. 3.On the secondary side 30, the R-tree transfer thread 56 receives thecapsule information and constructs a partition page in the shared memory36 on the secondary side 30 to store the duplicate R-tree capsule 60.

The R-tree transfer thread 54 on the primary side 10 further acquiresthe R-tree index pages 52 by reading corresponding partition pages ofthe shared memory 16 of the primary side 10, scans the index pages andtransfers them from the primary side 10 to the secondary side 30, asindicated by the dotted arrow in FIG. 3. On the secondary side 30, theR-tree transfer thread 56 receives the R-tree indexing information andconstructs partition pages in the shared memory 36 on the secondary side30 to store the duplicate R-tree index pages 62.

The R-tree transfer thread 56 on the secondary side 30 registers theR-tree index defined by the capsule and index pages 60, 62 bycommunicating registration information 70 to the secondary server 32 asindicated in FIG. 2. In the exemplary Informix Dynamic Serverenvironment, for example, the R-tree transfer thread 56 on the secondaryside 30 registers the R-tree index with the Informix Dynamic Serverprogram. Once the R-tree index is created and is consistent on thesecondary side 30, the R-tree transfer thread 56 on the secondary side30 sends an acknowledgment 72 to the R-tree transfer thread 54 on theprimary side 10, as indicated in FIG. 3. Responsive to receipt of theacknowledgment 72, the R-tree transfer thread 54 on the primary side 10removes the lock 66 on the R-tree index.

The R-tree index transfer threads 54, 56 preferably operate to duplicatethe R-tree index from the primary side 10 to the secondary side 30 atthe time the R-tree index is created. Alternatively, if the highavailability data replicator is started some time after the R-tree indexis created, the R-tree index transfer threads 54, 56 preferably operateto duplicate the R-tree index from the primary side 10 to the secondaryside 30 as part of initial startup of the high availability datareplicator connection.

In any event, the R-tree index transfer threads 54, 56 should operate toduplicate the R-tree index from the primary side 10 to the secondaryside 30 prior to execution of any database transaction that accesses theR-tree index. In this way, when a database transaction accesses theR-tree index through the R-tree access method 48 on the primary side 10,the transaction log entries of the database transaction are transferredto the secondary side 30 by the high availability log-based datareplicator. The transferred log entries are replayed on the secondaryside 30 by the log replay module 44. During the replaying of the logentry that accesses the R-tree index, an R-tree access method 78references the contents of the duplicate R-tree capsule 60 and theR-tree index pages 62 on the secondary side 30 to carry out thetransaction.

In the exemplary Informix Data Server, the R-tree access methods 48, 78are provided by the Informix Dynamic Server environment. However, inother database system environments, the R-tree access method may be oneof the user-defined routines, or may be a routine supplied separatelyfrom the database system server software. In these cases, the R-treeindex transfer threads 54, 56 preferably transfer the R-tree accessmethod along with the user-defined routines of the specific R-treeindex, and the registration information 70 includes information forregistering the R-tree access method with the secondary server 32.

In the illustrated embodiment, the high availability data replicator isa separate component from the R-tree index transfer threads 54, 56.However, it is also contemplated to integrate the R-tree index transferthreads 54, 56 with the high availability data replicator to define aunitary database backup system that provides the advantageous hot-backupcapability of high availability data replication and that alsoencompasses hot-backup of the R-tree index.

High availability data replication that supports an R-tree index throughthe R-tree index transfer threads 54, 56 has been described. However,those skilled in the art will readily recognize that the describedapproach can be used to provide high availability data replication thatsupports other types of indexes employing user-defined routines that arenot duplicated by a log-based data replicator. Still further, thoseskilled in the art will readily recognize that the approach can be usedmore generally to provide High availability data replication thatsupports substantially any type of user-defined routine that is accessedby the database system but that is created by operations that do notproduce database transaction logs.

The invention has been described with reference to the preferredembodiments. Obviously, modifications and alterations will occur toothers upon reading and understanding the preceding detaileddescription. It is intended that the invention be construed as includingall such modifications and alterations insofar as they come within thescope of the appended claims or the equivalents thereof.

1-8. (canceled)
 9. A database backup system for monitoring a databasedeployed on a primary server and for maintaining a copy of said databaseon a secondary server, the database backup system including: a datareplicator in operative communication with the primary and secondaryservers to copy database log entries from the primary server to thesecondary server and to update the secondary server using the copieddatabase log entries; and a user-defined routines replicator inoperative communication with the primary and secondary servers to copyuser-defined routines deployed on the primary server to the secondaryserver and to deploy the copied user-defined routines on the secondaryserver.
 10. The database backup system as set forth in claim 9, whereinthe user-defined routines define an R-tree index and the user-definedroutines replicator includes: a lock mechanism for locking the R-treeindex; a capsule extractor that retrieves stored encapsulatedinformation about the user-defined routines defining the R-tree indexand copies the retrieved encapsulated information over to the secondaryserver; an R-tree data extractor that retrieves R-tree index data andcopies the retrieved R-tree data over to the secondary server; and anunlocking mechanism for unlocking the R-tree index.
 11. The databasebackup system as set forth in claim 10, further including: a log replaymodule that replays the copied database log entries on the secondaryserver to effect update of the secondary server, the log replay moduleaccessing the copied encapsulated information and the copied R-tree dataresponsive to replaying database log entries that call for accessing theR-tree index.
 12. The database backup system as set forth in claim 9,wherein the user-defined routines define an R-tree index and theuser-defined routines replicator includes: a first thread executing onthe primary server that transmits the user-defined routines deployed onthe primary server to the secondary server; and a second threadexecuting on the secondary server that receives and deploys the copieduser-defined routines on the secondary server to create a copy of theR-tree index on the secondary server.
 13. The database backup system asset forth in claim 12, wherein: the first thread locks the R-tree indexon the primary server during the transmitting; and the second threadsends an acknowledgement to the first thread indicating that secondthread received the user-defined routines, the first thread unlockingthe R-tree index responsive to receipt of the acknowledgement.
 14. Thedatabase backup system as set forth in claim 9, wherein the user-definedroutines replicator is integrated into the data replicator to define aunitary database backup system.
 15. An article of manufacture comprisingone or more program storage media readable by a computer and embodyingone or more instructions executable by the computer to perform a methodfor maintaining a multi-dimensional index of contents of a databasesystem that includes a primary database deployed on a primary side, asecondary database deployed on a secondary side, and a data replicationmodule replicating contents of the primary database to the secondarydatabase by replaying database log entries of the primary database onthe secondary side, the method including: after creation of themulti-dimensional index of contents and prior to executing databaseoperations that access the multi-dimensional index of contents,performing in index replication process including: locking themulti-dimensional index on the primary side, copying themulti-dimensional index to the secondary side; unlocking themulti-dimensional index on the primary side; wherein after theperforming of the index replication process, database operations thataccess the multi-dimensional index of contents are performed on theprimary side and database log entries corresponding thereto are replayedon the secondary side, the replaying accessing the copy of themulti-dimensional index on the secondary side.
 16. The article ofmanufacture as set forth in claim 15, wherein the multi-dimensionalindex is a range tree index.
 17. The article of manufacture as set forthin claim 16, wherein the copying of the range tree index to thesecondary side includes: copying a capsule containing user-definedroutines defining the range tree index to the secondary side.
 18. Thearticle of manufacture as set forth in claim 17, wherein the copying ofthe range tree index to the secondary side further includes: copyingentries of the range tree index to the secondary side.
 19. The articleof manufacture as set forth in claim 15, wherein the performing of anindex replication process further includes: registering the copy of therange tree index on the secondary side with the secondary database. 20.The article of manufacture as set forth in claim 19, wherein thesecondary database system is selected from a group consisting of anInformix Dynamic Server and DB2 database.